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1.  Introduction 

The  one  variable  minimization  problem 

minimize  f (x)  s.t.  L  £  x  <_  U  (1) 

is  important  in  optimization  theory  because  it  often  arises  as  a  subalgorithm 
Cor  solving  general  constrained  nonlinear  programming  problems  in  several 
variables.  Convergence  proofs  for  some  standard  methods  (see  e.g.  (7],  [8]) 
assume  that  either  the  first  smallest  local  minimizer  for  the  problem  be 
found,  or  that  a  global  minimizer  is  obtained.  (A  local  minimizer  is  a  point 
associated  with  a  local  minimum  to  the  problem. )  When  f(x)  is  not  a  unimodal 
function,  standard  algorithms  for  solving  (1)  may  yield  minitnizers  which  are 
neither  the  first,  nor  the  global  ones. 

In  this  paper  a  new  method  based  on  simple  observations  is  presented 
for  finding  a  global  minimizer  of  (1).  This  method  applies  when  the  function 
to  be  minimized  has  continuous  derivatives  of  higher  order.  It  is  further 
restricted  to  cases  where  the  number  of  zeros  of  the  derivative  of  f(x)  in 
(L,Ul  is  finite.  It  is  not  difficult  to  find  functions  (e.g.,  xsin(l/x)  , 

0  1  x  i  fl/2)  which  do  not  satisfy  this  restriction.  For  most  practical 
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problems  this  presents  no  difficulty.  The  computational  requirements,  i.e., 
actually  computing  the  higher  order  derivatives,  are  met  for  a  large  class 
of  functions  called  Factorable  Functions  (see  [2],  [4])  using  formulas 
developed  in  [6].  This  aspect  of  the  problem  will  not  be  further  commented 
on  here. 

This  new  method  is  also  an  alternative  to  the  method  of  Goldstein 
and  Price  [3]  for  finding  the  global  minimizers  of  polynomials. 

2.  Preliminary  Theorems  and  Leninas 

The  algorithm  for  finding  global  minimizers  is  based  on  three  simple 
theorems,  all  of  which  are  well  known.  The  first  one  states  the  obvious  fact 
that  finding  all  the  zeros  of  the  first  derivative  in  an  interval  is  equiva¬ 
lent  to  finding  the  global  minimizer. 

Theorem  1.  Suppose  f:E^ — ^  is  once  continuously  differentiable 

in  the  interval  [L,U]  .  Suppose  that  there  are  p  zeros  of  the  derivative 

in  that  interval  and  that  they  are  known  and  ordered  as 

L  <_z^  *  z2  <***<2p  —  u  *  Then  a  global  minimizer  for  the  problem 

min  f(x)  s.t.  xe[L,Uj"  must  be  one  of  L.tz^}  i*l,...,p,  U  . 

Proof.  A  well-known  necessary  condition  that  a  point  in  (L,U)  be 
local  unconstrained  minimizer  is  that  the  point  be  a  zero  of  the  derivative. 
Thus  if  a  global  minimizer  is  an  interior  point,  it  must  be  one  of  z^,...,z 
If  it  is  a  boundary  point  it  obviously  must  be  one  of  L  or  U  . 

The  second  theorem  asserts  that  a  function  is  strictly  monotone  in  an 

interval  if  its  derivative  has  constant  sign  there.  Furthermore  the  function 
can  have  at  most  one  zero  there  and  a  simple  test  determines  whether  it  does. 

Theorem  2.  Suppose  f :E^— ^  E^  is  kth  continuously  differentiable  in 

the  interval  [a,b]  .  Suppose  further  that  f  (x)  >  0  (<0)  in  (a,b)  . 

Then  f*  ^"(x)  is  strictly  monotone  increasing  (decreasing)  in  [a,b]  ,  and 

k-1 

there  is  only  one  possible  zero  of  f  (x)  in  [a,b]  .  Specifically,  if 
k-l  k-1 

f  (a)*f  (b)  <  0  ,  there  is  exactly  one  zero  there,  and  if 

-  2  - 
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k-l  k-1 

f  (a)*f  (b)  >  0  ,  there  is  no  zero  in  that  interval. 

Proof.  From  the  mean  value  theorem,  for  any  y,z  e[a,b]  , 

fk  ^(y)-fk  *(z)  =  fk(n)(y-z)  for  some  nc(a,b)  . 

The  monotonicity  follows  directly  from  this  equality  and  the  assumption  that 
fk(x)  >  0  (<  6)  in  (a,b)  . 

k— 1  k-l 

If  f  (a)*f  (b)  0  ,  then  one  is  greater  than  or  equal  to  zero 

and  the  other  is  less  than  or  equal  to  zero.  Continuity  of  fk  *  implies 

k-l 

the  existence  of  at  least  one  point  where  f  is  zero.  The  strict  mono¬ 
tonicity  shown  above  proves  that  only  one  such  point  exists  in  the  interval. 

k-l  k-l 

If  f  (a)*f  (b)  >  0  ,  then  both  values  have  the  same  sign.  The 

monotonicity  property  then  implies  all  in  between  values  are  of  that  sign, 

Q.E.D. 

The  third  theorem  provides  the  basis  for  the  upward  process  of  the 
global  minimizing  algorithm.  It  says  essentially  that  if  all  the  zeros  of  a 
function's  first  derivative  are  known  (in  an  interval),  then  the  function 
itself  can  have  at  most  one  more  zero.  Furthermore  the  zeros  of  the  first 
derivative  (with  the  interval  endpoints)  provide  the  intervals  in  which  the 
zeros  of  the  function  are  located,  (one  possible  zero  in  each  interval). 

Theorem  3.  Suppose  f:E^— ^  E*  is  kth  continuously  differentiable  in 

A  *  k 

the  interval  [L,U]  .  Suppose  that  f  has  q  zeros  in  that  interval  and 

that  they  are  known  and  ordered  as  L  <  z,  <  z_  ...  <  z  <  U  .  Then  f  (x) 

“12  q  - 

is  strictly  monotone  in  [L.z^,  [z^z^^]  (for  i=l , . . .  ,q-l)  ,  and  [  ,U]  . 

i  .  A  A 

There  are  at  most  q+1  zeros  of  fK-A  in  |L,U]  .  Specifically,  there  may 
be  one  in  [L.z^]  ,  one  in  each  of  (f°r  i“l». • • »q-l)  ,  and  one  in 

[z^,U]  .  If  f'lt-l(L)*f  (Zj)  >  0  there  is  no  zero  in  that  interval,  otherwise, 

there  is  exactly  one  there.  If  (for  i»l,...,q-l)  fk  ^(z^'f*  ^(z^+j)  >  0  » 


-  3 

i 
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there  is  no  zero  in  that  interval,  otherwise  there  is  exactly  one.  Finally, 
k-1  k-1  ' 

if  f  (z^)*f  (U)  >  0  there  is  no  zero  in  [z^,U]  .  Otherwise,  there  is 

exactly  one. 

k  k 

Proof.  Since  f  (z^)  =  f  (z^+p  *  0  >  and  there  are  no  zeros  between 

k  lr 

zj  and  zi+1  ,  then  f  (x)  >  0  for  all  xc(zi,zi+])  ,  or  f  (x)  <  0  in  that 

open  interval.  Thus  the  hypotheses  of  the  previous  theorem  are  satisfied  and 
the  appropriate  conclusion  follows  for  [z^z^]  .  The  other  cases  are  identical. 

The  last  theorem  provides  a  rationale  for  eliminating  subintervals  from 
consideration  as  locations  of  the  global  minimizers  if  information  concerning 
an  approximation  to  the  global  minimum  value  is  available. 

Theorem  4.  Suppose  f(x)  is  a  continuous  scalar  function  in  the 
interval  [L,U]  .  Let  Xq  be  a  point  in  [L,U]  whose  function  value  is  known 

(i.e.,  f(Xg)  has  been  computed).  Then 

min  f (x)  s.t.  xc[L,U]  *  min  f(x)  s.t.  xe{x|f(x)  xc[L,U]}  . 

Proof.  The  proof  is  omitted. 

3.  Algorithmic  Considerations 

Central  to  the  development  of  an  algorithm  based  on  the  theorems  of 
the  previous  section  is  the  availability  of  a  subalgorithm  which  is  guaranteed 
to  find  the  zero  of  a  strictly  monotonic  function  in  an  interval. 

Let  a(x)  be  a  scalar  valued  function  which  is  continuous  and  strictly 
monotonic  in  the  interval  [a,b]  .  Assume  that  a(a)*a(b)  £  0  .  Consider  the 
problem: 

find  x  ,  the  unique  point  in  [a,b]  such  that  a(x)  -  0  .  (2) 

A  method  for  solving  this  problem  is  called  a  Guaranteed  Zeroizing  Algorithm 
(GZA)  if  it  is  guaranteed  to  generate  the  solution  in  a  finite  number  of  steps, 
or  generate  an  infinite  sequence  converging  to  x  . 

One  simple-minded  GZA  for  solving  problem  (2)  is  as  follows. 

-  4  - 
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If  o(a)  =0  or  a(b)  =  0  ,  quit.  Otherwise,  assume  without  loss 
of  generality,  that  a(a)  <  0  and  a(b)  >  0  .  Set  aQ  *  a,bQ  *  b  .  In 

general,  at  iteration  k  assume  that  x  is  known  to  lie  in  (a^.b^)  . 

(Certainly  by  assumption  this  is  true  for  k=0  .)  Calculate  where 

m^  *  (a^+bjt)/2  .  If  aOn^)  =  0  *  set  x  =  m^  and  quit.  Otherwise,  there 

are  two  possible  cases. 


If  a(m^)  >  0  , 

assumption  that  a(x) 
interval. 


86t  ak+l=  ak  *  and  bk+l  =  “k  * 
is  strictly  monotonic  increasing. 


Because  of  the 
x  must  lie  in  this 


If 


lak+l,bk+l 

terminated 


a(m^)  <  0  ,  set  a^^  *  m^  »  ^+1  =  bk  '  ^8ain»  x  must  lie  in 

]  .  If  the  resulting  interval  is  small  enough,  the  algorithm  is 

St 

.  Otherwise  the  (k+1)  iteration  is  initiated. 


There  are  many  "faster"  methods  for  attempting  to  solve  (2).  If  the 
function  a(x)  is  continuously  differentiable  in  [a,b]  ,  then  Newton's 
method  can  apply.  This  takes  the  form 

xk+l  =  xk  -  al(xk)'la(xk)  * 


The  method  of  golden  sections  can  be  applied  by  minimizing  (or  maximizing 
depending  upon  whether  a(x)  is  monotone  increasing  or  monotone  decreasing)  the 
f unct ion 

x 

/a  «(t)dt 


in  [a,b]  .  The  secant  method  for  this  problem  takes  the  form 

Xk+i =  [xk  "  Vi  a(xkn  '  la(Vi)  -  °<\>i  • 

The  method  of  golden  sections  is  a  GZA  for  Problem  (2).  Both  Newton's 
method  and  the  secant  method  can  be  modified  so  as  to  become  GZAa.  Without  modi¬ 
fication  they  can  generate  points  outside  [a,b]  ,  or  otherwise  fail  to  converge. 

There  are  many  algorithms  based  on  the  theorems  of  Section  2  which  can 
be  used  to  find  all  the  zeros  of  f*(x)  in  [L,U]  ,  or  find  a  global  minimlzer 
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of  f(x)  in  [L,IJ[  when  the  number  of  zeros  of  f^  is  finite  in  that  interval. 
The  basic  idea,  is  first  to  divide  the  interval  (L,U]  into  subintervals,  find- 
I  ing  for  each  subinterval  some  derivative  of  f  which  has  constant  sign.  Then, 

j  using  the  backward  process  implied  by  Theorem  3,  each  subinterval  is  analyzed, 

‘  finding  all  the  zeros  of  successive  lower  level  derivatives  of  f  until  all  the 

zeros  of  f*(x)  in  that  subinterval  (if  any)  have  been  located.  Finally,  the 

\ 

<  zeros  over  all  the  subintervals  are  examined  (along  with  the  endpoints  L  and 

U)  ,  and  the  global  minimizers  obtained.  The  results  of  Theorem  4  can  be  used 
also  to  eliminate  from  consideration  any  subinterval  in  which  the  function  value 
is  higher  or  equal  to  the  lowest  function  value  at  a  feasible  point. 

Essential  to  the  development  of  an  algorithm  using  the  results  of 
Theorem  3  is  the  capability  of  generating  tight  upper  and  lower  bounds  on  deriva- 
'  tives  of  f(x)  .  For  a  large  class  of  functions,  called  Factorable  Functions, 

this  capability  is  available.  For  references  see  [2],  [4],  and  [6].  All  that 
‘  is  required  is  the  availability  of  interval  bounds  on  simple  functions  of  a 

single  variable  (sin,  log,  etc.).  Complicated  compositions  of  these  simple  func¬ 
tions  make  up  most  functions  of  a  single  variable.  Bounds  on  sums  and  products 
and  trausformat ions  of  interval  bounds  are  obtained  through  simple  arithmetic 
computations.  This  aspect  of  the  algorithm  will  not  be  elaborated  on  here.  In 
the  example  some  of  the  techniques  are  used. 

The  rigorous  statement  of  the  tight-bounding  capability  is  as  follows. 

I.et  { f  l.i,U1  ] }  be  a  sequence  of  nested  intervals  contained  in  [L,U]  such 

that  IK  -  Lj  — y  0  .  An  algorithm  generates  tight  bounds  on  the  kth  derivative 

lc  i  lc  ii. 

of  f  if  it  is  capable  of  generating  a  sequence  {v^’  .v^’  }  where  for  every 

i  , 

v*’1  [rain  fk(x)  s.t.  xe|L^,Uj]]  [max  f^(x)  s.t.  xt[l.^,lK]]  <  vj’^ 

and  v^’*-  -  v!4’1  — ^  0  as  U.  -  L.  — ^  0  . 

U  L  j  i 

These  ideas  will  be  applied  to  the  problem:  minimize  xsin(x)  -  exp(-x) 
subject  to  xe[0,2ir|  .  The  graph  of  this  function  is  given  in  Figure  1.  There 


-  6  - 
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,  are  two  local  minimizers,  one  at  0.,  and  the  other  at  4.911770  (*  l.r>63465  n ) 

The  successive  derivatives  take  the  forms: 

f1(x)  =  sin(x)  +  xcos(x)+exp (-x)  , 

2 

f  (x)  *  2cos(x)-xsin(x)  -exp(-x)  , 

3 

f  (x)  =  -3sin(x)-xcos(x)  +exp(-x)  . 

In  computing  tight  upper  and  lower  bounds  on  these  expressions  the  only 
capability  assumed  will  be  that  of  obtaining  the  exact  upper  and  lower  bounds 
on  the  forms:  sin(x) ,cos(x) ,  exp(-x)  for  x  in  a  given  interval  contained  in 
[0. ,2v]  .  From  these  values  the  standard  techniques  of  interval  arithmetic 
(see  [5]  for  a  fuller  discussion  of  these)  are  used  to  bound  the  products  and 
sums.  The  general  formulas  used  here  are  as  follows.  Suppose  for  x  in 
[L,U]  ,  a  <_  a(x)  b  ,  and  c  £  8(x)  d  .  Then  a  +  c  a(x)  +  B(x)  <  b  +  d  , 
and  min[ar ,ad,bc,bd]  £a(x)*6(x)  £  max[ac,ad,bc,bd]  .  (Subtraction  is  dealt 
with  in  the  obvious  way.) 

The  results  of  Theorem  4  can  be  used  if  some  preliminary  one  dimensional 
search  routine  is  assumed  to  have  been  applied  to  the  problem.  Depending  upon 
the  parameters  used  by  the  routine  it  would  have  found  either  the  local  minimi - 
zor  at  0.  ,  or  that  at  4.911770  .  It  is  assumed  that  the  former  is  available, 
i.e.,  Xq  =  0.  ,  and  f(Xg)  “  ”1  • 

The  initial  bounds  on  the  first  derivative  in  10., 2u]  are 
-7.2813  <  f1(x)  <  8.2832  . 

This  interval  is  divided  into  two  halves,  [0.,ir]  and  [ir,2ir]  .  For 

xc(0. ,  tt  ]  ,  f(x)  >_  -1  .  Search  in  this  interval  is  terminated  since  no  better 

point  than  xQ  =  0.  ,  f(Xg)  =  -1  can  be  found  there.  For  xe[tt,2h]  , 

|  -6.3264  £  f (x)  £  -.0019  ,  -7.2813’<  f1  (x)  <  3.1848  ,  -9.2832  <  f2(x)  <  8.2813. 

?  of  the  three  functions  allow  upward  processing  of  this  interval  so  it  will  be 

•  further  subdivided  into  [ir,37i/2]  and  [3n/2,2n]  .  For  xefir,3Ti/2]  , 

\ 

f  • 


None 


-  8  - 
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-4,7556  <  f(x)  £  -.0090 
-5.7034  £  f 3  ( x )  <  .0432 
-2.0432  <  f 2 (x)  <  4.7034 
.0090  £  f3(x)  £  7.7143  . 

The  lowest  derivative  with  constant  sign  in  that  interval  is  the  third. 
Thus  the  upward  processing  of  this  interval  can  begin  once  the  remaining  interval 
is  examined  and  a  derivative  with  constant  sign  found  there. 

For  xe[3n/2,2u]  ,  the  first  three  derivatives  have  bounds  containing 
zero.  The  interval  is  further  subdivided  into  [3it/2, 7tt/4]  and 
[7tt/4,2tt]  . 

2 

For  xf.[3n/2,7iT/4]  ,  the  lowest  derivative  with  constant  sign  is  f 
with  3.3232  £  f^(x)  £  6.9079  .  For  xs[7ir/4,2n  1  ,  the  first  derivative  is 
positive  with  3.1823  £  f^-(x)  £  6.2873  .  Conceptually  the  situation  is  depicted 
in  Figure  2. 


f(x)  >  f(0) 


f3  >  0 


f1  -  0 


Figure  2.  Derivative  bounding  information. 
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The  upward  processing  of  the  Intervals  to  find  all  the  zeros  of 
fX(x)  now  proceeds. 

3 

The  interval  [tt,3it/2]  is  processed  first.  Here  f  (x)  >  0  .  Now 
f^(n)  =  -2.0432  ,  f^(3n/2)  =  4.7034  .  Thus  there  is  exactly  one  zero  of 
in  that  interval.  The  secant  method  is  used  to  find  it.  The  successive 
iterations  are  given  in  Table  1. 


Table  1 

SECANT  METHOD  ITERATES 


i 

Xi 

f2(x.) 

0 

it 

-2.0432 

1 

3ir/2 

4.7034 

2 

3.6173 

-.1482 

-1 

3 

3.6545 

.2477  x  10 

-2 

4 

3.649236 

.168  x  10 

5 

3.649199 

-.5189  x  10"5 

The  point  3.649199  is  the  zero  in  that  interval.  The  first  derivative  can 
have  at  most  one  zero  in  [w, 3. 649199]  and  at  most  one  in  [3. 649199, 3 n / 2 ] 
since  the  second  derivative  is  monotone  in  each  interval.  Evaluating, 
fl(n)  -  -3.0983,  fi(3. 649199)  -  -3.6491  ,  f  1<3ti/2)  =  -.9910  .  Hence  there  is 
no  zero  to  the  derivative  in  either  interval. 

The  second  derivative  is  strictly  positive  in  f 3tt/2,7h/4]  . 
Evaluating,  f1(3ir/2)  -  -.9910,  f1(7n/4)  »  3.1845  .  So  there  is  exactly  one 
zero  there.  Applying  any  GZA  would  yield  the  point  4.911770  . 
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Since  in  the  final  interval  f^  >  0  ,  obviously  there  are  no  zeros 
of  the  derivative  there. 

The  process  has  been  completed  and  the  zero  4.911770  has  been 
identified  as  the  global  minimizer  for  the  problem.  Note  that  if  the  interval 
had  not  been  eliminated  the  above  process  would  have  found  the  local 
maximizer  since  the  associated  zero  would  have  been  located. 

4.  Application  to  Polynomial  Minimization 

The  problem  of  finding  the  global  minimizers  of  a  polynomial  relates 
to  Problem  (1)  in  the  following  way. 

Consider  the  polynomial  approximation  to  f(x)  using  some  point 
in  [L,U]  : 

f(x)  =  P°(x)  =  f(xQ)  +  };.=1  fi(xQ)(x-x0)i/i!  . 

The  most  that  f(x)  and  P°(x)  can  differ  by  is  +  c  ,  where 

c  [max<lfmiil*lfmax1)]  fmax( ju-xj , | L-xQ | ) ]k+1/ (k+1) !  , 
k+1  kH 

where  f  =  min  f  (x)  s.t.  L<x<U,  and 
mm  —  — 

k+1 

.k+1  f  (x)  s.t.  L  <  x  <  U 

f  =  max  —  — 

max 

One  approach  for  minimizing  f(x)  in  [L,U]  is  to  approximate  it  by 
a  polynomial  as  above  and  minimize  the  polynomial.  Depending  upon  the  level 
of  differentiability  and  the  capability  of  computing  the  higher  derivatives, 
the  minimum  of  the  polynomial  can  be  made  very  close  to  that  of  the  original 
function. 

Using  the  results  of  Theorem  3  it  is  very  simple  to  minimize  the 
polynomial.  The  kth  derivative  is  of  constant  sign  (if  it  is  zero  the  first 
nonvanishing  derivative  below  the  kth  is  used  to  start  the  process)  and  the 
process  of  finding  the  zeros  of  the  successive  polynomials 
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k  k-1  1 

P  (x) ,  P  (x),...,  P  (x)  can  be  initiated.  This  process  is  guaranteed  to 
find  all  the  zeros  of  P^(x)  from  which,  by  virtue  of  Theorem  1,  all  the  local 
minimizers  (and  therefore  the  global  minimizers  of  P^(x))  can  be  determined. 

The  maximum  amount  of  work  now  done  in  the  upward  process  is  the  use 
of  a  GZA  as  many  times  as  required.  The  most  work  is  if  each  level  contains 
one  more  zero  finding  problem.  The  work  in  this  case  would  be 
1+2+. ..+  (k-1)  =  k(k-l)/2  zero  finding  problems.  Hopefully,  in  practical 
problems  the  actual  work  would  be  less,  and  certainly  at  the  highest  level  one 
would  not  expect  more  than  three  zeros  of  the  derivative. 

This  algorithm  is  an  alternative  to  that  of  Goldstein  and  Price  13] 
which  "divides  out"  local  minimizers  from  polynomials  and  eventually  calculates 
all  local  minimizers  of  a  polynomial.  In  Fiacco  and  McCormick  [l]  a  worse  case 
analysis  shown  that  for  a  polynomial  of  degree  k  (k  assumed  even)  the  number 
of  one  dimensional  minimization  problems  (yielding  a  local  solution)  could  be 
as  much  as 

k/2  +  2_1)  t  (k/2-i)  Ilj^1(k/2-J)l  . 

In  addition,  the  Gold stein-Price  scheme  is  subject  to  severe  numerical  problems 
since  exact  minimization  is  necessary  in  order  to  divide  a  polynomial  of  degree 
two  into  a  higher  degree  polynomial  to  perform  the  analysis.  This  present 
scheme  is  relatively  insensitive  to  numerical  problems  since  the  numbers  obtained 
arc  endpoints  of  interval  s. 


5.  Comment 

For  strictly  convex  programming  problems  the  second  derivative  of  the 
function  f(x)  is  greater  than  zero  which  implies  the  existence  of  at  most  one 
zero  to  the  derivative.  In  step-size  problems  resulting  from  the  minimization 
of  a  general  convex  function  in  several  variables  subject  to  points  being  restricted 
to  a  convex  set,  the  step-size  function  is  usually  strictly  convex.  For 
nonconvex  problems,  the  existence  of  more  than  one  zero  to  a  step  size  problem 
is  rarely  encountered.  It  does  happen,  and  in  such  a  circumstance  the  techniques 
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of  these  in  this  paper  are  applicable.  In  most  cases  just  using  first  and 
second  derivatives  in  a  technique  which  divides  the  original  into  subintervals 
should  suffice  to  obtain  a  global  minimizer  of  a  function  in  an  interval. 


-  13  - 


T-411 


REFERENCES 

[1]  FIACCO,  A.  V.  and  G.  P.  McCORMICK  (1972).  An  upper  bound  for  the 

Coldstein-Price  minimization  scheme.  Technical  Paper  Serial  T-271. 
Program  in  Logistics,  The  George  Washington  University. 

[2]  GHAEMI,  A.  and  G.  P.  McCORMICK  (1979).  Factorable  symbolic  factorable 

SUMT:  What  is  it?  How  is  it  used?  Technical  Paper  Serial  T-402. 
Institute  for  Management  Science  and  Engineering,  The  George 
Washington  University. 

[3]  GOLDSTEIN,  A.  A.  and  J.  F.  PRICE  (1971).  On  descent  from  local  minima. 

Math,  of  Computation  2^  (115)  569-574  July. 

T4]  McCORMICK,  G.  P.  (1976).  Computability  of  global  solutions  to  factorable 
nonconvex  programs:  Part  I — Convex  underestimating  problems.  Math. 
Programming  ^  (2)  147-175  April. 

[5]  MOORE,  R.  E.  (1966).  Interval  Analysis.  Prentice-Hall,  Englewood  Cliffs, 

New  Jersey. 

[6]  SHAYAN,  M.  E.  (1979).  A  methodology  for  comparing  algorithms  and  a 

method  of  computing  mth  order  directional  derivatives  based  on  fac¬ 
torable  programming.  D.Sc.  Dissertation.  Department  of  Operations 
Research,  The  School  of  Engineering  and  Applied  Science,  The  George 
Washington  University. 

• 

[7]  T0PK1S,  D.  M.  and  A.  F.  VEINOTT,  JR.  (1967).  On  the  convergence  of  some 

•  feasible  direction  algorithms  for  nonlinear  programming.  SIAM  J. 

Control  #  (2)  268-279. 


-  14  - 


[8]  WOLFE,  P.  (1965).  Foundations  of  nonlinear  programming:  Notes 
nonlinear  programming  and  extensions — Part  65.  RAND  Memo 
RM-4669-PR,  Santa  Monica,  California. 


)  • '  t 


To  cope  with  the  expanding  technology,  our  society  must 
be  assured  of  a  continuing  supply  of  rigorously  trained 
and  educated  engineers.  The  School  of  Engineering  and 
Applied  Science  is  completely  committed  to  this  ob¬ 
jective. 


